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SUMMARY 

In  previous  papers,  It  has  been  shovn:  that  the  functional 
equation  technique  of  dynamic  programriing  may  be  applied  to 
yield  the  numerical  solution  of  a  wide  class  of  variational 
problems  of  the  type  occurring  In  mathematical  physics, 
engineering,  and  economics. 

It  was  seen  that  the  numerical  solution  of  a  problem 
Involving  N  state  variables  depended  upon  the  computation 
of  sequences  of  functions  of  N  variables.  ITiIb  fact  made 
the  method  routine  only  for  the  case  where  N  ■  1  or  2,  with 
grave  difficulties  arising  In  the  general  case. 

In  this  paper.  It  Is  Indicated  how  to  overcome  this 
difficulty  for  a  large  class  of  problems  In  »;hlch  the  underlying 
equations  and  the  criterion  function  are  linear,  although  the 
restraints  on  the  forcing  functions  may  be  nonlinear,  corres¬ 
ponding  say  to  energy  considerations. 

The  same  methods  are  applicable  to  other  classes  of  linear 
equations,  and,  In  particular,  to  differential-difference 
equations,  arising  from  tine— lag  problems,  and  to  various 
classes  of  partial  differential  equations.  These  problems 
could  not  previously  be  treated  by  dynamic  prograimlng  tech¬ 
niques  In  any  useable  fashion. 

Finally,  It  Is  briefly  indicated  how  the  method  of 
successive  approximations  may  be  combined  with  the  foregoing 
techniques  to  reduce  general  variational  problems,  In  which  the 


equations  and  criterion  function  are  nonlinear,  to  sequences 
of  Droblems  which  can  be  solved  numerically  by  means  of 
sequences  of  functions  of  one  variable.  'Hiere  are  a  number  of 
Interesting  and  difficult  convergence  questions  associated 
with  this  program  which  we  do  not  discuss  here. 
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SOME  NEW  TSamiQUES  IN  THE 

DYNAMIC  PROORAMMINO  SOLUTION  OF  VARIATIONAL  PROBLEMS 

Richard  Bellman 


^1.  INTRODUCTION 

A  variational  problem  that  Is  encountered  In  many  parts 
or  pure  and  applied  mathematics  Is  that  of  determining  the 
minimum  or  maxlrr.um  o^  a  functional  of  the  form 

(l)  *^(y)  “  ^ ^ 2^ » ^2 » •  *  •  * ^ *^2 *  *  *  *  ^ 

over  all  functions  y^#  :'2»  *•*'  satisfying  the  relations 
dx. 

x^(0)  -  c^,  1  -  1,  2,  N, 

and  constraints  of  the  form 

(a)  x^(T)  -  b^,  1  -  1,  2,  R, 

(3) 

(b)  Rj(x;y)  <0,  J  -  1,  2,  k. 

For  a  variety  of  reasons  which  one  discovers  almost 
Immediately,  this  problem,  to  the  degree  of  generality  stated 
above,  presents  formidable  difficulties.  These  difficulties 
arise  not  only  in  connection  with  the  analytic  solution  of  the 
problem,  cf.  [9],  &.0]  ,  but  also  In  connection  with  the 
apparently  more  modest  der.and  for  a  numerical  solution.  We 
have  dls'^ussed  elsewhere  various  applications  of  the  theory  of 
dynamic  programming  to  the  numerical  solution  of  classes  of 
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varlatlonal  problemo  of  the  foregoing  t^npe,  [l]  ,  [2],  {j>] ,  [4]. 
In  tP.ls  paper  we  wish  to  Indicate  sone  recent  developments 
which  greatly  enlarge  the  scope  of  these  methods  presented  In 
the  cited  references.  In  addition,  these  new  developments, 
combined  with  the  classical  tool  of  successive  approximations, 
enable  uo  to  attack  systematically  classes  of  problems  formerly 
far  beyond  our  powers. 

We  shall  begin  our  discussion  with  a  terminal  control 
problem  for  a  linear  system  with  constant  coefficients.  The 
problem  Is  that  of  maximizing  a  functional  of  the  form 

(4)  J(y)  -  H(Xj(T),  x^lT),  x^(T)  ) 


over  all  f  jictlons 


y  1 »  y  o »  •  •  • »  y  V  > 


1'  •'p 

linked  by  linear  relations  of  the  form 

N 


where 


and  y  are 


(5) 


dx,  N 


hh'j' 


x^(0) 


1  -  1, 


and  the  y^  satisfy  restraints  of  the  tync 


(6) 


(a)  m^  <  y^(t)  <  m^',  0  <  t  <  T,  1-1,2, 

Kj(y^,y.,  .  .  .  ,yj,)dt  <  y  J  -  1,  2, 


/. 


Whereas  the  techniques  of  dynar.l  '  programiLlng  discussed 
previously  convert  th  is  varld^  lon^l  pi-oblerr.  Into  one  r-equlrlng 
the  computation  of  a  sequence  of  functions  of  h'  varlalles, 
the  linearity  of  the  aeflnlng  equation  In  (^)  enables  ur  to 
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transform  the  p  obler.  Into  one  Involving  a  sequence  of  functions 
of  k  variable j,  where  k  Is  as  In  (4). 

Since  current  digital  computers  do  not  take  kindly  to 
storage  of  functions  of  more  than  two  variables,  this  Is  a  very 
Important  reduction.  Trls  Is  particularly  so  since  a  large 
class  of  problems  occurring  In  the  fields  of  engineering  and 
industrial  economics  may  be  fonnulated  In  the  above  terms  with 
large  N  and  a  k  of  one  or  two. 

If  H(x^,Xp, . . . ,x^)  la  linear, 

(7)  H  -  2  “.X  , 

J-1  ^  J 

the  problem  may  be  still  further  reduced  to  the  computation  of 
sequences  of  functions  of  one  variable,  regardless  of  the 
value  of  k.  The  same  remark  holds  for  the  case  where  it  Is 
desired  to  maximize  a  linear  functional  of  the  form 


In  exactly  the  same  way  we  can  handle  discrete  control 
problems  where  difference  equations  replace  differential 
equations.  As  a  matter  of  fact,  these  techniques  were  developed 
In  connection  with  a  discrete  problem,  the  "caterer"  problem, 

[5]. 

The  same  methods  may  be  applied  to  the  treatment  of 
problems  Involving  time  lags  and  retarded  control,  cf.  [7], 

In  which  case  the  equations  corresponding  to  (5)  become 
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dx.  N  N  N 

(9) 

>'^(t)  »  c^(t),  0  <  t  <  6,  1  -  1,  2,  ...,  N. 

More  ccnipllcated  types  of  hereditary  processes  may  also  be 
treated  by  means  of  the  techniques  we  shall  present  below. 
Problems  of  this  kind  could  not  formerly  be  treated  by  dynamic 
programming  techniques  because  of  their  dependence  upon 
functionals  rather  than  functions. 

The  results  stated  so  briefly  In  tbe  foregoing  pa’^agraphs 
depend  In  an  essential  manner  upon  the  linearity  of  the 
equations  defining  the  process  and  upon  the  linearity  of  the 
criterion  function.  To  extend  those  tecJinlques  to  cover  more 
general  situations,  we  turn  to  that  general  factotum, the 
method  of  successive  approximations.  Using  this  basic  tech¬ 
nique  of  analysis,  we  show  how  a  variety  of  apparently  multi¬ 
dimensional  processes  can  be  reduced  to  computational  processes 
Involving  sequences  of  functions  of  one  variable.  Once  this 
has  been  done  we  have  a  feasible  approach  to  these  problems. 

A  large  number  of  Interesting  and  significant  problems 
Involving  convergence  of  these  motl'.ods,  rapidity  of  convergence, 
stability,  and  so  on,  arise  from  these  Investigations.  Tl.e3e 
will  be  discussed  in  detail  at  a  subsequent  date. 

^2.  D\TJAMIC  PROG  RAMMING 

In  order  to  appreciate  thie  Improvement  In  technique 
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afforded  by  the  methods  we  present  here,  let  us  sketch  briefly 
the  direct  approach  of  dynamic  programming  which  we  have  pre¬ 
sented  In  the  works  cited  above. 

Considering  the  general  problem  posea  In  ( 1.1)— (1.5) 
define  the  function  of  thie  N  variables  c^,  c^,  ...» 
and  T, 

'1}  f(<'-;^,G2, . . .  ,Cj^;T)  -  Max  J(y) 


where  the  maximum  la  taken  ova-  all  functions  y^(t)  satisfying 
(1.5).  Under  appropriate  assumptions  concerning  the  continuous 
dependence  of  maximizing  y^  upon  the  Initial  values  c^  and 
T,  we  obtain  for  f  a  nonlinear  partial  differential  equation 


(2) 


f  . .  .  ,Cjj,0)  •  0, 


where  the  maximization  Is  over  quantities  v^^  satisfying  the 
constraints 


(a)  <  m^ ' 

(3) 

(b)  nj(c,v)  <  0. 

Provided  that  F  and  C  are  suitably  differentiable, 
and  assuming  that  the  maximum  Is  alv/ays  assumed  inside  the 
region  of  variation,  this  nonlinear  partial  differential 
equation  leads  via  characteristics  to  the  usual  Euler  equations, 

[1], 


P-1148 

8-6-57 


COMPUTATIONAL  ASPECTS 

Since  the  analytic  solution  of  these  problems,  as  mentioned 
above.  Is  only  rarely  attained,  we  turn  to  computational  tech¬ 
niques. 

To  determine  f(cj^,  c^#  ...»  we  can  either  use 

(2.2)  and  any  of  a  number  of  standard  techniques  for  the 
numerical  solution  of  partial  differential  equations  of  this 
type,  or,  as  has  turned  out  to  be  preferable,  we  can  go  over 
to  a  discrete  version  of  the  original  continuous  process. 
Analytically,  this  means  that  the  original  differential 
equations  are  replaced  by  difference  equation?.  Thus,  (1.2) 
becomes 

(1)  x^(t*t6)  «  x^(t)  +  6  0^(x^(t),X2(t),...,Xj^(t); 

y2^( t ) , . . . ,yjyj( t ) ) ,  Xj^(o)  “  c^. 


with  t  assuming  only  the  values  0,  6,  25,  ...  , 

The  nonlinear  partial  differential  equation  Is  then  re¬ 
placed  by  the  nonlinear  recurrence  relation 


f(c,T) 


Max 

V 


[5  P  ( c  ;  V )  -f 


r(c^+5G^(c,v), 


v);  T-t)]. 


In  order  to  carry  out  the  Inrilcated  process,  we  must  be 
able  to  tabulate  functions  of  N  va'^lables.  Consequently, 
at  the  present  time  this  approa  -h  Ic  only  feasible  If  N  -  1 
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or  2.  For  N  >  2,  the  memory  requirements  become  prohibitive. 

It  Ip  necessary  then  to  develop  some  new  techniques  If  we 
wish  to  utilize  dynamic  programming  to  solve  large  scale  prob¬ 
lems  of  the  type  arising  In  the  engineering  and  economic 
spheres . 

PRELIMINARIES  ON  LINEAR  SYSTEMS 

In  this  section  we  shall  mention  some  v/ell— known  results 
concerning  the  solution  of  vector-matrix  systems  of  linear 
differential  equations.  These  will  be  utilized  In  what 
follows.  Proofs  of  the  results  cited  here  may  be  found  In  [^  . 

The  linear  system  of  (l.5)  rnay  ba  written,  using  an 
obvious  vectoi^-matrlx  notation,  in  the  form 

(1)  ^ 

Consider  first  the  case  In  which  A  Is  constant.  The  solution 
of  (l)  may  then  be  written  In  the  for^. 

(2)  X  -  e^^c  ^  e^^^^^By(s)ds. 

0 

If  A  -  A(t),  a  matrix  .dependent  upon  t,  then  x  may  be 
written  in  the  form 

(3)  X  -  X(t)c  ^  X(t)X^^(s)By(8)d8, 

0 

*  /  X 

where  X(t)  is  the  matrix  solution  of 
(“I)  ^  -  A(t)X,  X(0)  -  I. 
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We  shall  utilize  these  repre'^entatlona  In  a  cmclal 
manner  below. 

^5-  TERMINAL  CONTROL — I 

Let  US  now  turn  to  the  problem  of  maximizing  a  given 
function  H(x^(T) ,x^(T) , . . . ,x^(T) )  of  the  terminal  state  of 
the  system  over  all  control  functions  whilch  are  re¬ 
lated  to  the  by  means  of  the  linear  equation  In  (4.1), 

and  which  are  subject  to  the  constraints 

(a)  m^  <  y^(t)  <  ,  0  <  t  <  T,  1  «  1,  2,  N, 

(1) 

(t>)  G(yi  »yo»  •  •  •  iV.j)  it  <  k. 

0  ^  ^  a  - 


We  wlshi  to  show  that  th.e  nui''.cr*i«'al  solution  of  a  problem 
of  this  type  can  be  n;ade  to  depend  upon  a  sequence  of 
functions  of  k  variables,  rather  than  upon  sequences  of 
functions  of  N  variables.  We  shall  'onslJer  first  th.e  case 
whiere  A  •  ^^Ij^  ^  constant  matrix. 

We  begin  with.  th)e  linear  represi^ntatlon  of  (4.2),  which 
yields  a  set  of  equations 


(c  ) 


x^(  t ) 


Z.(t)  +  [V  X  (t^-c)y  (s)]d 


s. 


1. 


where  z^(t)  is  thie  1— ti  '  opponent  of 


At 


and  >:(t)  -  (x3^j(t)) 
bhe  problem  we  wish  to  consltior  may  t'^en  be  cast  In  the 


foiTi  of  maximizing  a  fuiictlonal  oi'  thie  type 
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[^2^  Xjj(T-s)yj(B)]d8,  ...,  Uj^ 

(3) 

••r 

N 

[  2  x^j(T-6)yj(s)]ds), 

where  u^,  u^,  are  given  quantltleo,  over  all 

functions  y^,  ...»  yj,j  eatlafylng  the  constraints  (la) 

and  (lb). 

Let  U3  then  consider  the  sequence  of  functions 
f  (uj^ ,Up, . . .  ,u^;T) ,  Implicitly  dependent  upon  X,  defined  as 
follows 


(4) 


fiu^#^^*  •  •  *  * ^ 


Max  [H(u^  +  [.  ..]ds,..., 


^ #3^2# •  •  •  »yjii )d83 » 


v/here  the  functions  y^(t)  are  nou'  constrained  by  (la). 

A  motivation  and  dlscusclon  of  the  use  of  the  Lagrange 
multiplier  may  be  found  In  ,  and  a  numerical  example  In  . 

The  value  of  the  method  lies  In  the  fact  that  enables  us  to 
reduce  multi— dimensional  problems  to  sequences  of  lower 
dimensional  problems. 

To  obtain  a  functional  equation  for  f  (u^,u^,  .  .  .Uj,;T) , 
we  proceed  as  follows.  Suppose  that  the  values  of 
y^(t),  yp(t),  ...,  yfj(t)  have  been  detei’mlne  i  over  [0,5j  . 


Then  we  may  write 
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H{u,  +y’'^  [...]ds,  u.  [...]ds) 

•‘•  0  0 

/t  T 

-  •  ,yjj)ds 

-  H(u^  [--.Ids  ^  [...]d8,  ..., 

[...Ids  +,/’’■  [...]d3) 

0  6 

^5)  Q(yi.y2»  •  •  •  o(yi»y2»*--»yN)^® 

-  H(u^  [. .  .Jds 

^  0 

;T_^S  N 

+  /  IX  X.  .{T-6_6)y  .(s+6)]ciB, .  .  .  ) 

0  J-1  J 

-  Q(yi»y2/ •  •  •  »yN)d3 

-  0(yi(s-«-6),...,yj,j(6+6))ds. 

The  principle  of  optlrnallty  cf.  [l]  then  yields  the 
fvinctlonal  equation 

f  ( u t u^ I  f i T )  “  g”*  ^ ^(yi^jy^*  •  •  •»yj|j) ds  ■♦■ 

(j)  CX  X  (T-8)y.(B)]d8,..., 

^j?i 
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The  niaxlmum  Is  now  taken  over  all  functlono  y^(8)  defined 
over  0  <  3  <  5,  and  satisfying  the  constraints 

mi'  <  yi(s)  <  mi  In  [0,6]  . 

For  computational  purposes,  we  may  use  the  approximate 
relation 


(T) 


f  (u^,Up,  .  . .  ,u^;T)  -  Max  [  -  X6  0(  v^,v^, .  .  .  ,Vjj )  + 


N 


N 


or  wo  may  start  with  a  discrete  version  of  the  original  process. 

We  have  thus  reduced  the  numerical  solution  of  the 
variational  problem  to  the  determination  of  a  sequence  of 
functions  of  k  variables.  If  k  -  1  or  f,  we  have  a 
feasible  method  of  solution. 


y.  TERMIN/VL  CONTHOL — VARIADL£  COEFFICIENTS 

It  Is  Important  In  connection  with  our  subsequent  discussion 
of  the  use  of  successive  approxlmdtlons  to  consider  the  same 
problem  for  the  case  where  A  is  a  variable  matrix.  Let  us 
consider  then  the  ^ase  v/here  the  equation  governing  the  process 
has  the  form 

(1)  ^  “  ''(tjx  +  P(t)y  +  x(0)  -  c. 


As  we  know,  the  solution  of  t!  Is  equation  Is  given  by  the 
expression 
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X  «•  X(t)c  X(t)X“^(8 )b(b )y(s )d8  + 

0 

(2) 

X(t))r^(8)^(8)ds. 


Hence  the  componente  of  x(T)  has  the  form 
(5)  x^(T)  -  [X  ^ij(T,s)yj(B)]d8, 

0  ij"l 

where  the  are  Independent  of  y. 

In  order  to  take  account  of  the  non— etatlonarlty  of  the 
process,  we  count  time  baclcwards.  In  place  of  noting  the  time 
at  which  the  process  ends,  we  single  out  the  time  at  which  It 
begins.  Fixing  T,  we  consider  the  function  f  (uj^,U2, . . .  ,Uj^;r) 
defined  by  the  relation 

f(u.,,Up,...,u  ;r)  -  M^x  [H(u,  + 

y[r,T]  1 

,rn  N 

y  Wlj(-»e)yj(8)]dB,  ...,  Uj^  + 

y^  C***jds)  X y^  ^(yT/yp»«»*,yjij)ds'] . 

Arguing  as  In  the  preceding  section,  we  see  that  f  satisfies 
the  relation 

A  (u,  jU^, .  .  •  ,Uj^j  r )  •  Max  T—  xy'^  Q(y't  »yo»  •  •  •  »y>i)d8 

yy,r+6J  r 

+  f(u,  +y^  .  .3  ds , . . .  ,u. 

r  * 


(5) 
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For  computational  purposes,  this  reduces  to 


(6) 


f  (uj^,U2, . . .  ,u^;r)  -  Max  [^  -  X6  a(vj^ ,V2# .  •  • . Vj^)  + 

N 

f(uj^  ®  2k  •••• 


with  . . .  ,\i^;T)  -  0. 

<q7.  terminal  control — LDJEAR  CRITSPION 

Let  us  now  consider  the  case  where  H  Is  a  linear  function. 
More  generally,  let  us  consider  the  problem  of  maoclmlzlng  the 
Inner  product  (x(T),a)  where  a  Is  a  given  vector.  To 
simplify  the  notation,  let  us  consider  only  the  case  where  A 
Is  a  constant  matrix. 

Using  the  representation  for  x(t)  given  In  (4.2),  v;e 
see  that 


(l)  (x(T),a)  =  (e^'^c,a)  +  (  V{s )d8 ,a) . 

AT 

Neglecting  the  term  (e  c,a),  v;hlch  Is  Independent  of  y, 
we  have  the  problem  of  maximizing 

(^)  J(y)  -  e^^'^“®^y(s)d3,a) 

‘■0 


over  all  aatlafylng  the  constralntc 
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(a)  <  "ii'#  0  <  t  <  T,  1  -  1,  2,  ...»  N, 

(3) 

(b)  Q(yj^,y2»  •  •  •  »yj^)d8  ^  k. 

Introduce  the  function 

(4)  f(k,T)  -  Max  J(y), 

y 

where  the  maxlmuin  la  over  all  functions  y^^  satisfying  (3a) 
and  (3b). 

It  Is  easy  to  see  that  f(k,T)  satisfies  the  equation 

f(k,T)  -  Max  [(y’^  e^^^"^Vds,a) 
y[o,6]  "o 

(5)  +  f(k  a(y^,y2,....yj^)ds,  T-6 )]  , 

\ 

f(k,0)  s  0. 

For  computational  purposes,  we  can  use  the  relation 

(6)  f(k,T)  -  Max  C6(e^'^v,a)  +  f(k-6  0(  v^  ^v^, .  . .  ,Vj^)T-6  )]  . 

We  see  then  that  In  the  case  wher-e  the  underlying  equation 
Is  linear,  the  criterion  function  Is  linear,  and  there  Is  only 
one  constraint  of  the  form  In  (3b),  v/e  can  compute  the  solution 
using  sequences  of  fvinctlons  of  one  variable. 

If  there  are  two  constraints  of  the  type 
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we  Introduce  a  Lagrange  multiplier  and  consider  the  problem  of 
maximizing 

(8)  (x(T),a)  -  03^(yi»y2»  •  •  •yN)<JS‘ 

For  eacJi  value  of  X  we  have  a  one— dimensional  problem.  As 
the  parameter  X  la  varied,  we  range  over  a  set  of  values  of 
the  constraint  J  0^(y^,y^, . . .  ,yj^)ds. 

tth.  T2HMINAL  nOUTFOL  VS.  G'i^JFPAL  CONTROL 

The  general  conti*ol  problem  Is  that  of  maximizing  a 
functional  of  the  form 

(l)  J(y)  F(x,y)dt  +  H(x(T)), 

0 


subject  to  relations  and  constraints  of  the  type  described 
above . 

If  we  introduce  a  neu'  scalar  variable  means 

of  the  relation 


(f) 


dx 


IRl 

rrr“ 


0, 


v/e  see  tfiat  we  once  again  have  a  terminal  control  problem. 

In  par-ticular,  the  problem  of  maximizing  a  linear 
functional  of  the  fon.! 


(3) 


'•ji 


P-1148 

8.-6-57 

1 


15  reailly  treated  by  the  above  methods. 

^9.  TIME  LAG  PROBLEMS 

As  we  have  seen  in  the  foregoing  sections,  the  success  of 
our  methods  rested  upon  the  superposition  principle.  Given  an 
equation  of  the  form 

L(x)  =«  y, 

(1) 

^-0  • 

we  were  able  to  write  the  solution  in  the  fonri 
(?)  X  -  >:(t)c  +  T(y), 

and  thus  avoid  Interaction  between  the  initial  conditions  and. 
the  forcing  function. 

Put  In  these  terms,  It  Is  jlear  that  the  same  methods 
will  handle  the  case  v/here  the  linear  oper'ator  L  Is  represented 
by  a  differential— difference  ope^’ator  of  t!  e  ^ype  given  in 
(1.9).  'fhe  requisite  representation  tf'.eorems  nay  be  found  In 

[7]. 

(|10.  FAFMAL  DIFFJ’^K'"IAL  ^iQUATIOHS 

Similarly,  a  variety  of  control  problems  acsoclated  with 


the  heat  equation 
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“t  ■  “xx  * 

(l)  u(x,0)  -  c(x),  0  ^  X  1 

u(0,t)  -  u(l,t)  -0,  t  >  0, 


may  be  treated. 

We  shall  reserve  a  detailed  exposition  of  problems  of 
this  type  for  a  future  date. 

t^ll.  SUCCESSIVE  APPROXIMATIONS 

Let  U3  now  briefly,  without  entering  into  any  rigorous 
discussion,  which  la  non— trivial.  Indicate  how  the  method  of 
successive  approximations  may  be  combined  with  the  foregoing 
techniques  so  as  to  reduce  general  control  problems  Involving 
nonlinear  differential  equations  and  nonlinear  criteria  to 
sequences  of  computational  problems  Involving  functions  of  one 
variable . 

Consider  the  problem  of  maximizing 


(1)  j(y)  -  H(xj(T),  X^(T)) 


over  all  y  subject  to 


dx 


(a)  ^  “  aj^(x,y),  x^(0)  -  1  -  1,  C,  ...,  N, 


(?)  (b)  <  y^  <  ,  1  «  1 N, 


(c)  0(.y3^,y2>  •  •  •  it  <  I- . 
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Let  72^^^*  •••*  Initial 
gueJiK  In  policy  spade,  and  let  ..., 
be  the  resultant  x— values,  detemlned  by  (2a). 

Consider  the  new  criterion  function 


Jo(y)  -  H(x^<°'(T),x^'^^(T), 


(0) 


(?) 


k 


l>l('!')  -  Xj<°'(T)]  (x^<°>(T) . x,/°> 


(T 


and  the  new  system  of  differential  equations 


x^(0)  »  c^,  1  =■  1,  2,  .  .  . ,  N. 

The  new  variational  pi’oblem  Is  that  of  maximizing 
over  all  y  satisfying  (h)  and  the  constraints  (2b)  and  (2c). 

Since  the  criterion  function  and  the  system  of  (iirfei'— 
entlal  equations  are  linear,  tlie  r.etl.ods  outlined  In  the  foi'e— 
going  pages  peimnlt  us  to  solve  this  problen  by  means  of  a 
sequence  of  one— dimensional  functions. 

Let  the  maximizing  y(t)  be  called  :'^^^(t).  Proceeding 
as  above,  we  deteiTr.lne  an  '■  ^  ^  ^  ( t ) ,  and  fomulate  a  new 
variational  pix)blen  as  In  (^)  an  i  ( ’  ) .  Proceeding  in  this 
way  we  foimn  a  sequen.e  of  one— dimensional  problcr..3  v;hlcli  we 
hope  converges  to  the  solution  of  tf c  original  problem. 
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